Decentralized Knowledge and Learning in Strategic Multi-user Communication

نویسندگان

  • Yi Su
  • Mihaela van der Schaar
چکیده

A. Motivation Multi-user wireless communications systems form competitive environments, where heterogeneous and strategic users compete for the available spectrum resources. These heterogeneous devices may differ in terms of their adopted standards and architectures, their deployed communication algorithms, their experienced environment (e.g. channel conditions and traffic characteristics), their application-defined utilities etc. [1]. Moreover, these devices can also significantly differ in their ability to sense the environment and acquire information about other users sharing the same spectrum, exchange information and negotiate spectrum access rules with the competing users and, ultimately, learn and reason based on the available information to select their optimal transmission strategies. Importantly, in most communication scenarios, users compete for resources in a strategic manner, i.e. they aim at maximizing their own utilities. The majority of past multi-user communications research has focused on analyzing and quantifying the performance of various multi-user environments, where transceivers with similar standards, algorithms or utilities share the available spectrum resources. An underlying assumption has been that the users select their transmission actions based on either complete or no knowledge about their competitors’ protocols, strategies, utility functions, environment etc. In this report, the term “knowledge” represents the correct beliefs 1 of users about their opponents and the

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Expected Achievable Distortion of Two-User Decentralized Interference Channels

This paper concerns the transmission of two independent Gaussian sources over a two-user decentralized interference channel, assuming that the transmitters are unaware of the instantaneous CSIs. The availability of the channel state information at receivers (CSIR) is considered in two scenarios of perfect and imperfect CSIR. In the imperfect CSIR case, we consider a more practical assumption of...

متن کامل

Online Learning in Decentralized Multiuser Resource Sharing Problems

In this paper, we consider the general scenario of resource sharing in a decentralized system when the resource rewards/qualities are time-varying and unknown to the users, and using the same resource by multiple users leads to reduced quality due to resource sharing. Firstly, we consider a user-independent reward model with no communication between the users, where a user gets feedback about t...

متن کامل

An Online Q-learning Based Multi-Agent LFC for a Multi-Area Multi-Source Power System Including Distributed Energy Resources

This paper presents an online two-stage Q-learning based multi-agent (MA) controller for load frequency control (LFC) in an interconnected multi-area multi-source power system integrated with distributed energy resources (DERs). The proposed control strategy consists of two stages. The first stage is employed a PID controller which its parameters are designed using sine cosine optimization (SCO...

متن کامل

A Novel Multi-user Detection Approach on Fluctuations of Autocorrelation Estimators in Non-Cooperative Communication

Recently, blind multi-user detection has become an important topic in code division multiple access (CDMA) systems. Direct-Sequence Spread Spectrum (DSSS) signals are well-known due to their low probability of detection, and secure communication. In this article, the problem of blind multi-user detection is studied in variable processing gain direct-sequence code division multiple access (VPG D...

متن کامل

Learning Complex Swarm Behaviors by Exploiting Local Communication Protocols with Deep Reinforcement Learning

Swarm systems constitute a challenging problem for reinforcement learning (RL) as the algorithm needs to learn decentralized control policies that can cope with limited local sensing and communication abilities of the agents. Although there have been recent advances of deep RL algorithms applied to multi-agent systems, learning communication protocols while simultaneously learning the behavior ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/0804.2831  شماره 

صفحات  -

تاریخ انتشار 2008